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The steady states of the master equation are investigated. We give two expressions 
for the steady state distribution of the master equation a la the Zubarev-McLennan steady 
state distribution, i.e., the exact expression and an expression near equilibrium. The latter 
expression obtained is consistent with recent attempt of constructing steady state theormo- 
dynamics. 

In daily life, nonequilibrium steady states (NESS) are observed in various sit- 
uations, such as electric current, heat conduction, and so on. Usually the linear 
response theory (Kubo formula^^) and Onsager's reciprocal relation'^) are used to de- 
scribe the NESS, i.e., the NESS near equilibrium. Recent advances in experimental 
aspects need the study of the NESS far from equilibrium. Thus understanding of 
the NESS is one of challenges in nonequilibrium statistical mechanics. However, our 
knowledge on the NESS has been limited until the discovery of the fluctuation the- 
orem. ^^^^''^ The fluctuation theorem is not restricted to near equilibrium. Thus the 
fluctuation theorem provides us with some clue to investigate the NESS for general 
settings. 

In this Letter, the NESS of the master equation is investigated. The master 
equation describes number of physical, chemical, biological, and even social phe- 
nomena. Usually the master equation was investigated by the i7-expansion.^^)"^^) 
Without the use of the /?-expansion, we develop a theory for the NESS of the master 
equation using the recent development of the fluctuation theorem. The key relation 
is the detailed imbalance relation which is used to show the fluctuation theorem. 
Thanks to the detailed imbalance relation, the master equation is exactly solved and 
we obtain the steady state distribution in a similar form of the Zubarev-McLennan 
steady state distribution.^^)' However, this expression is not convenient to handle 
with. In a linear approximation near equilibrium, a much familiar expression is ob- 
tained, which is indeed in a form of the Zubarev-McLennan steady state distribution. 
Compared with the result on the NESS of the master equation, ^^^'^^^ we examine 
the expression obtained for the steady state distribution and compare it with the 
recent results. ^^^'^^^ 

The master equation is given by 



d_ 
di 



Wi^ii^P{(ji!';t) 





where u: = {u;i,uj2, ■ ■ ■ ,ujnY is the discrete variable of the state. P{u;t) is the 
probability distribution that the system is in state u at time t. Wi^^^i is the transition 
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rate that the system performs a transition from state u to state cj' in a unit time. By 
definition, the transition rates Wi^cj' are non-negative. Equation ^ can be rewritten 
into the following form.^''^ 

^^P{u;t) = Y,W^>^P{Lj';t), (2) 



where 



(3) 



Since the master equation conserves the total probability, the transition rates 
satisfy the following condition. 



0. 



(4) 



This relation can be confirmed directly. Therefore, an alternative form of the master 
equation is obtained. 



d 



(5) 



Hereafter we consider this master equation. Note that the transition rates W^^f^i are 
no longer non-negative and the diagonal elements W^^^^ are non-positive. 
Now we assume the detailed imbalance relation'^^"^'''' Rl : 



where (Juiuj'it) is the entropy production for one jump u uj' . Using Eq. 
is rewritten as 

^P(^; t) = P{u- 1) (exp[-a^^Ki)] " 1) W^u:'- 



Equation ([7]) is easily solved. 

P{u]t) = C(cu;0)exp 



/* dt' V (exp[-a^^,(i')] - 1) 
Jo 



(6) 
Eq. (0) 

(7) 
(8) 



where C(cj; 0) will be determined later. As in the standard definition, here we set 

P{u;t) = eM-S{u:;t)]. (9) 

Equation ^ is rewritten as 



r rt 



P(cj;t) = C(c^;0)exp 



C(w;0) exp 



, dP{u-t')/dt' 
P{uj;t') 

dt' S{u-t'] 



C(^;0) exp [S{u;0) - S{u-t)] 



(10) 



*•* Sometimes it is called the nonequilibrium detailed balance relation. 
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To be consistent with Eq. ([9]), it should be C{u;0) = exp[-S'(a;; 0)]. Thus, Eq. ^ 
is a formal (exact) solution. 

For the NESS, the steady state distribution is given by 



exp 



exp 



/•oo 

-S{u;; 0) + / dt' V] (exp[-(j^^/(t')] - l) 
■Jo 

-S{u;;0)+ dt' yW^^>y-{-a^^>(t')y 



:ii) 



This is the first main result and is nothing but the exact expression of the NESS, 
which is similar to the Zubarev-McLennan steady state distribution. However, 
Eq. (Ilip is not in a useful form. Thus, we consider a NESS near equilibrium. 
Near equilibrium, the entropy production is small. So we can approximate as 
exp(— o") ~ 1 — o", i.e., the linear approximation near equilibrium. Then, we ob- 
tain the probability distribution 



P{ijj; t) ~ exp 



-5(cc;;0) - f dt' ya^^>{t')W^ 
Jo 



(12) 



Near equilibrium, the steady state distribution is approximated as 



exp 



where 



and 



S{uj; 0) - / dt' y a^^' {t')W^u 
Jo ^ 

roo 

:exp -5(cj;0)- / dt' {E{u;;t') - {J{u))} 

L ^0 

1) = y{S{J; t) - S{u; t)}W^^,, 



(J(u;)) = -^VF^^, In 



(13) 
(14) 

(15) 



This is the second main result. X'(cj; t) is the total entropy production including the 
incoming entropy production flow, i.e., ^AS{u). (J(a;)) is the entropy production 
flow, i.e., ^AeS{u). Thus, i7(cj; t) — {J{uj)) is the (internal) entropy production, i.e., 
^AiS{u) = ^{AS{lj) — AeS{uj)). Thus, the argument of the exponential function in 
the second line of Eq. (|13p expresses the time integration of the minus of the excess 
entropy production or the internal entropy production. 

The averaged entropy production in the NESS is given by^''-''"^*) 



P'^{u:')W^ 



This expression can be written in terms of Kolmogorov-Sinai (KS) entropy. 



18) 



(a) = 



(16) 



(17) 
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where h is KS entropy and is KS entropy for the reversed process. Since 

thus this quantity resembles the content inside of the sum in the right hand side of 
Eq. (jl6p . This quantity can be identified with the excess entropy production in state 

Consider the entropy in state u. From Eq. (|12p . we obtain 

Siu;t) = -In P{u;t) 
= Sicj;0) + 



E 1^ dt' I VF^^, {S{J- 1') - S{u- 1')) + W^^, In ^ I 



(19) 



This equation expresses the time-evolution of the entropy S{u:;t). Taking time 
derivative of Eq. (|19p and noting Eq. ^ , we have 

j^Siu; t)=Y^ W^^>S{u:'; t) - ( J(^)) . (20) 

If we use the matrix notation for the transition rates W^^i^/, and the vector notations 
for the entropy S{u;t) and the steady entropy production current {J{u)), we have 

S{t) = \NS{t) - J. (21) 

This can be easily solved as 

S{t) = e™5(0) - f ds e-^("-*) J. (22) 
Jo 

In the NESS, the following condition is satisfied. 

Y,W^'u:P'\uj') = 0. (23) 

Here we have set the right hand side of Eq. to be zero. Eq. (p3]) implies that 
there exist zero eigenvalues for the matrix W. Now we assume that at t = oo, 
the state reaches the NESS. As a result, the steady state distribution is given by 
P**(a;) = exp[— S''^*(a^)] = exp[— S'(a;; oo)]. Thus, we have 



~ exp 

where 



hm yZlie'^X^.Siu'-O) - f ds (e'^^^-*))^^, J^,} 



(24) 



j^, = -Y^W^,^.\u^^. (25) 
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This is the third main result. The rank of the matrix W is smaUer than its matrix 
size. We assume that the matrix W has only one zero eigenvalue and the others 
are negative eigenvalues, since the diagonal elements of the matrix W have negative 
values (See Eq. The first term in the argument of the right hand side of Eq. ()24p 
converges to the element of the eigenvector corresponding to the zero eingevalue, i.e., 
the NESS. 

We have demonstrated that near equilibrium, the solution of the master equation 
is solved analytically. The time-evolution of the entropy and the distribution func- 
tion was obtained and the steady state distribution near equilibrium was evaluated. 
To include nonlinear effects far from equilibrium, i.e., beyond the linear approxima- 
tion, one should include the nonlinear terms (n = 2, 3, • • • ) in the argument of the 
exponential function in the second line of Eq. (jlip . But this task would be tedious. 
At present, there is no results in this direction. 

The expression of Eq. (jl3p is very similar to the result of recent attempt of 
constructing steady state thermodynamics. Now we rewrite Eq. (|13p into the 
form of the expression derived by Komatsu and Nakagawa.'^''-' Noting that 0"^^^^/ (t) = 
—o'u:'u}{t), Eq. can be rewritten as 



P {(jj) ~ exp 



1 1 /"°° 

-Siu; 0) + - / dt' (^c.'Ut')Wu.u:' - 2 / dt' (T<.c.'{t')W^. 

J -co ^1 Jo ^, 

(26) 

This equation is similar to Eq. (15a) and (15b) in Ref. 20). 

Finally one question remains: "/s the Zubarev- McLennan steady state distribu- 
tion for the NESS near equilibrium?' Eq. (fT3]) (i.e., the expression near equilibrium) 
seems to correspond to the Zubarev-McLennan steady state distribution.^^)' ^^-^ 

The author is grateful to K. Kitahara and H. Tomita for continuous encourage- 
ment and to S. Takesue for pointing out a mistake. 
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